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cellular specimen. According to one embodiment, a plurality 
of excitable markers are applied to the specimen. A multi- 
photon laser microscope is provided to excite a region of the 
specimen and cause fluorescence to be radiated from the 
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analyzer to separate the fluorescence into respective wave- 
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SYSTEM AND METHOD FOR MONITORING 
CELLULAR ACTIVITY 

CROSS-REFERENCE TO RELATED 
APPLICATION(S) 

This application is a continuation of patent application 
Ser. No. 09/628,219, filed Jul. 28, 2000 now U.S. Pat. No. 
6,403,332, which claims benefit of provisional patent appli- 
cation No. 60/146,490, filed Jul. 30, 1999, and No. 60/164, 
504, filed Nov. 9, 1999. 

STATEMENT REGARDING FEDERALLY 
SPONSORED RESEARCH OR DEVELOPMENT 

The invention described herein was made in the perfor- 
mance of work under a NASA contract, and is subject to the 
provisions of Public Law 96-517 (35 USC 202) in which the 
Contractor has elected to retain title. 

FIELD OF THE INVENTION 

The present invention relates to the monitoring of cellular 
activity through the use of excitable markers. More 
particularly, the invention relates to a system and method for 
using a plurality of fluorescent probes to monitor cellular 
activity. 

BACKGROUND OF THE INVENTION 

Presently, fluorescence microscopy is one of the most 
widely used microscopy techniques, as it enables the 
molecular composition of the structures being observed to 
be identified through the use of fluorescently-labeled probes 
of high chemical specificity, such as antibodies. However, its 
use is mainly confined to studies of fixed specimens because 
of the difficulties of introducing antibody complexes into 
living specimens. For proteins that can be extracted and 
purified in reasonable abundance, these difficulties can be 
circumvented by directly conjugating a fluorophore to a 
protein and introducing this back into a cell. It is believed 
that the fluorescent analogue behaves like the native protein 
and can therefore serve to reveal the distribution and behav- 
ior of this protein in the cell. 

An exciting, new development in the use of fluorescent 
probes for biological studies has been the development of 
the use of naturally fluorescent proteins as fluorescent 
probes, such as green fluorescent protein (GFP). The gene 
for this protein has been cloned and can be transfected into 
other organisms. This can provide a very powerful tool for 
localizing regions in which a particular gene is expressed in 
an organism, or in identifying the location of a particular 
protein. The beauty of the GFP technique is that living, 
unstained samples can be observed. There are presently 
several variants of GFP which provide spectrally distinct 
emission colors. 

Conventionally, fluorescence microscopy only worked 
well with very thin specimens or when a thick specimen was 
cut into sections, because structures above and below the 
plane of focus gave rise to interference in the form of 
out-of-focus flare. However, this can be overcome by optical 
sectioning techniques, such as multi-photon fluorescence 
microscopy. 

Multi-photon fluorescence microscopy involves the illu- 
mination of a sample with a wavelength around twice the 
wavelength of the absorption peak of the fluorophore being 
used. For example, in the case of fluorescein which has an 
absorption peak around 500 nm, 900 nm excitation could be 
used. Essentially no excitation of the fluorophore will occur 
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at this wavelength. However, if a high peak-power, pulsed 
laser is used (so that the mean power levels are moderate and 
do not damage the specimen), two-photon events will occur 
at the point of focus. At this point the photon density is 
5 sufficiently high that two photons can be absorbed by the 
fluorophore essentially simultaneously. This is equivalent to 
a single photon with an energy equal to the sum of the two 
that are absorbed. In this way, fluorophore excitation will 
only occur at the point of focus (where it is needed) thereby 
10 eliminating excitation of the out-of-focus fluorophore and 
achieving optical sectioning. 

Often, multiple fluorophores are used, with each fluoro- 
phore having a different spectra, some of which may over- 
lap. Typically, the ability to distinguish between the respec- 
15 five fluorophores is only possible where the excitation and 
emission spectra are separated, or where the fluorescence 
lifetimes are distinct. 

Another approach is to selectively excite different fluo- 
rophores by using various excitation photon wavelengths, 
20 each of which will approximate the wavelength of the 
absorption peak of a corresponding fluorophore. Such an 
approach is not practical for a number of reasons. Firstly, it 
is difficult to rapidly tune the excitation wavelength of the 
laser providing the excitation photons. Secondly, there is 
25 typically a very broad excitation spectrum, so that such an 
approach makes it difficult to excite a single dye. 

Thus, the need exists for a system and method for 
efficiently monitoring a plurality of fluorescent probes, and 
to selectively record the signal from those probes for sub- 
30 sequent analysis. The present invention addresses these 
needs. 

SUMMARY OF THE INVENTION 

Briefly, the present invention is directed to a system and 
35 method for monitoring cellular activity in a cellular speci- 
men. According to one illustrative embodiment of the 
invention, a plurality of excitable markers are applied to the 
specimen. A multi-photon laser microscope is provided to 
excite a region of the specimen and cause fluorescence to be 
40 radiated from the region. The radiating fluorescence is 
processed by a spectral analyzer to separate the fluorescence 
into wavelength bands. The respective fluorescence bands 
are then collected by an array of detectors, with each 
detector receiving a corresponding one of the wavelength 
45 bands. 

According to another embodiment, the invention is 
directed to a system for monitoring cellular activity in a 
cellular specimen that contains a plurality of excitable 
markers. The system includes a laser microscope that is 
50 operative to excite the markers in a region of the specimen, 
so that those markers in the region radiate fluorescence. The 
system also includes a tunable filter that is operative to 
process the fluorescence and to pass a portion of the fluo- 
rescence wavelengths radiated by the markers. The system 
55 still further includes a detector that is operative to receive the 
processed fluorescence wavelengths. 

In still another embodiment, the invention is directed to a 
system for monitoring cellular activity, including a two- 
photon laser microscope that is operative to excite the 
60 markers in a region of the specimen such that the markers in 
the region radiate fluorescence. The system also includes a 
detector that is operative to receive non-descanned fluores- 
cence from the specimen. 

65 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic diagram of a first illustrative 
embodiment of the present invention; 
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FIG. 2 is a schematic diagram that illustrates one embodi- 
ment of a spectral analyzer included in the system of FIG. 

l; 

FIG. 3 is a schematic diagram that illustrates a system 
according to another illustrative embodiment of the inven- 5 
tion; 

FIG. 4 is a schematic diagram that illustrates yet another 
illustrative embodiment of the invention; 

FIG. 5 is a schematic diagram that illustrates still another 
embodiment of the invention; 

FIG. 6 is a flow chart that depicts the operational flow of 
processing software to process spectral data received by the 
systems of any of FIGS. 1 through 5 according to one 
illustrative embodiment of the invention; !5 

FIGS, la-c depict emissions spectra for various fluores- 
cent dyes; and 

FIG. Id depicts a measured spectrum from a specimen 
that contains plural different dyes. 

20 

DETAILED DESCRIPTION OF THE 
INVENTION 

Referring to FIG. 1, a novel system 10 is disclosed for 
capturing spectral data from a specimen 12 to which a 
plurality of excitable markers have been applied. In one 25 
embodiment, at least two fluorescent dyes (i.e., fluorescent 
probes) are applied to the specimen. The fluorescent dyes 
have respective emission spectra that may or may not 
overlap. In the case where the emission spectra are very 
similar, it becomes difficult to separate out the emission 30 
spectra to determine the contributions of each of the fluo- 
rescent dyes to the observed spectra. System 10 facilitates 
making such determinations in an efficient, reliable manner. 

As shown in FIG. 1, system 10 includes a laser 14 that 
generates laser light. The light emitted by laser 14 is focused 
by a lens 16 onto a short pass dichroic mirror 18. As is well 
known, the dichroic mirror 18 selectively reflects light 
according to its wavelength. Thus, the dichroic mirror is 
selected such that it reflects the light emitted by laser 14. 

The reflected light from dichroic mirror 18 is directed 
toward scanning optics, shown schematically at 20. The 
scanning optics may include a controllable deflection unit, 
or any other suitable structure that allows the reflected light 
to be redirected for scanning of the specimen 12 by the laser 45 
light, as is well known to those skilled in the art. 

The directed light from scanning optics 20 is imaged by 
a microscope lens 22 onto or into the specimen 12. The laser 
light excites the fluorescent dyes in the region where the 
light is directed, such that those dyes fluoresce and emit light 50 
having respective emissions spectra. 

In one embodiment, laser 14 is a two-photon laser. As is 
well known, a two-photon laser microscope depends on the 
twophoton effect, by which the fluorescent dyes are excited 
not by a single photon, but rather by two relatively low 55 
energy photons that are absorbed contemporaneously by a 
fluorescent dye. Thus, the requirement for two coincident (or 
near coincident) photons to achieve excitation of the fluo- 
rescent dye means that only focused light reaches the 
required intensities and that scattered light does not cause 60 
excitation of the fluorescent dyes. As such, a two-photon 
laser microscope is inherently insensitive to the effects of 
light scattering in thick slices. Alternatively, the laser 14 may 
comprise some other multi-photon laser, or a single -photon 
laser. 65 

The fluoresence radiated by the excited dyes is focused by 
the microscope lens 22, and passes through the scanning 
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optics 20 and dichroic mirror 18. The fluorescence is then 
focused by a lens 24 and directed to a light guide 26 that 
delivers the focused light to a spectral analyzer 28. Spectral 
analyzer 28 receives the light and disperses the light into 
respective wavelength bands. Each band is detected by a 
corresponding detector, and the intensity of each band is 
recorded and processed to determine the ingredients of the 
received fluorescence, as is described in more detail below 
in connection with FIG. 2. 

Referring to FIG. 2, there is shown one illustrative 
embodiment of spectral analyzer 28. Spectral analyzer 28 
includes a housing 30 formed with a light entrance opening 
32 and a light exit opening 34. Light entrance opening 32 is 
connected to light guide 26 to receive light from the light 
guide. Preferably, the distal end of light guide 26 includes an 
exit slit 27 to permit the delivery of fluorescence from light 
guide 26 to spectral analyzer 28. Mounted within spectral 
analyzer 28 is a first mirror 36 that directs the incoming light 
to a grating 38, which disperses the light over appropriate 
wavelength range. The dispersed light is then directed to a 
second mirror 40 that directs the dispersed light through the 
exit opening 34. In place of the grating 38, spectral analyzer 
28 may alternatively include a prism or other light- 
dispersing structure. 

Aligned with exit opening 34 is a detector array 42 
consisting of individual detectors 43. The detector array 42 
may take many different forms, such as an array of photo- 
multiplier tubes (PMTs), multiple window PMTs, position- 
dependant wire detectors, position/time-sensitive detectors, 
a photodiode array, an intensified photodiode array, charge - 
coupled devices (CCDs), intensified CCDs, an SIT or other 
video camera, or any other suitable optical- to -electrical 
transducer. 

In any event, the detector array 42 is preferably a linear 
array, with the respective wavelength bands being incident 
upon a corresponding one of the detectors 43. Each detector 
43 in the array receives the light incident upon it and 
generates a corresponding analog electrical signal. The 
electrical signals are then introduced to respective analog- 
to -digital converters (shown schematically at 44) which 
convert the incoming analog signals into corresponding 
digital signals. The digital signals are then delivered to a 
processor 46 that processes the digital signals to determine 
the constituents of the emissions spectra, as is described in 
more detail below. 

Referring now to FIG. 3, there is shown a system 50 
according to an alternative embodiment of the invention. In 
place of spectral analyzer 28, system 50 includes a tunable 
filter 52 that is interposed between lens 24 and a single 
detector 54, for example, a PMT. In one embodiment, 
tunable filter comprises a liquid crystal tunable filter (LCTF) 
that utilizes liquid crystals to continuously vary the retar- 
dance of individual filter stages, resulting in a narrow band 
filter that is electrically tunable over a wide spectral range. 
Alternatively, the tunable filter 52 may comprise an acousto- 
optical tunable filter. In any event, tunable filter is controlled 
by a suitable control unit 56 to vary the bandpass of the filter 
through the spectral range. At each bandpass, detector 54 
receives fluorescence and generates a corresponding elec- 
trical output signal, which is converted to digital format by 
an analog-to-digital converter 58 and then introduced to 
processor 46 for processing. 

Referring now to FIG. 4, there is shown a system 60 
according to still another embodiment of the invention. 
System 60 includes a long pass dichroic mirror 62 placed in 
the light stream between the scanning optics 20 and the 
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microscope lens 22. The dichroic mirror 62 is selected such 
that wavelengths corresponding to the fluorescence radiated 
by the specimen are reflected by the mirror 62, while the 
laser light from laser 14 passes through without being 
reflected. The reflected fluorescence is directed to a focusing 5 
lens 64, and then introduced to light guide 26 which delivers 
the light to spectral analyzer 28. As described above, spec- 
tral analyzer disperses the light and passes the light on to 
ADC 44, which converts the respective bands into digital 
signals and introduces the digital signals to processor 46. 10 

System 60 is therefore suitable for use in connection with 
a non-descanned two-photon microscope. By diverting the 
radiated fluorescence before it passes through the scanning 
optics 20 , a signal of increased intensity is received by 
spectral analyzer 28, as compared with a signal that passes 15 
through scanning optics 20 and dichroic mirror 18 before 
being received by a spectral analyzer or detector. Thus, the 
dwell time at each pixel can be reduced as a result. 

Referring now to FIG. 5, a system 70 is shown according 
to another embodiment of the invention. System 70 includes 20 
a light collector 72 that substantially surrounds specimen 12 
and includes a reflective inner surface. Thus, light emitted by 
fluorescent dyes within specimen 12 are collected by the 
collector, regardless of the direction in which the light 
radiates. In one embodiment, collector 72 comprises an 25 
integrating sphere. Alternatively, collector 72 may be in the 
shape of an ellipsoid or other structure that substantially 
encompasses specimen 12 to collect a substantial amount of 
the light radiating from specimen 12 , for example, an 
elliptical mirror. Collector 72 connects to light guide 26 to 30 
deliver the collected light to spectral analyzer 28. 

Thus, in use of the various systems described above, laser 
light is directed by dichroic mirror 18, scanning optics 20 , 
and focusing lens 22 to a region of specimen 12. The 35 
photons (either from a single-photon laser or from a multi- 
photon laser) excite the fluorescent dyes in the region, 
causing them to fluoresce. The entire emitted spectrum is 
received and processed simultaneously in certain of the 
illustrative embodiments to speed up the collection process. 4Q 
The spectral information is then processed to determine the 
amounts of each dye contributing to the emitted spectrum. 

Referring now to FIG. 6 , operation of processor 46 is 
described in greater detail. In one embodiment, processor 46 
is programmed to execute a linear unmixing operation upon 45 
the incoming spectral data to approximate the quantities of 
each fluorescent dye that contributed to the emitted spec- 
trum. As shown in FIG. 6 , operation begins at step 100 by 
determining spectral characteristics for the respective indi- 
vidual fluorescent dyes. As is well known in the art, each of 50 
the fluorescent dyes emits a particular spectrum over a 
certain wavelength band and at certain varying intensities 
within that band (see FIGS, la-c which illustrate examples 
of emissions spectra for three different fluorescent dyes). At 
step 102 , data relating to the probe spectra is recorded in 55 
processor memory for subsequent retrieval. 

At step 104, processor 46 receives the measured imaging 
spectrum data from ADC 44 (see FIG. Id), and retrieves the 
characteristic spectra for the various fluorescent dyes. At 
step 106, the measured spectrum is decomposed into the 60 
various component dye spectra. This can be accomplished in 
many different ways. In one embodiment, processor 46 
generates a model spectrum from the individual templates, 
and compares the model spectrum with the actual recorded 
spectrum. The respective weights of each of the individual 65 
templates are then varied to arrive at a close approximation 
of the actual spectrum. Then, at step 108, processor 46 
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determines the weights of each dye to quantitate the respec- 
tive dye intensities. 

In another embodiment, processor 46 is programmed to 
carry out principal component analysis (PCA) on the incom- 
ing data. As is well known in the art, PCA is a linear model 
which transforms the original variables of an emission 
spectrum into a set of linear combinations of the original 
variables called principal components, that account for the 
variance in the original data set. Suitable forms of PCA 
algorithms are disclosed in U.S. Pat. No. 5,991,653 to 
Richards-Kortum et al., and U.S. Pat. No. 5,887,074 to Lai 
et al., the disclosures of which are hereby expressly incor- 
porated by reference. 

Preferably, system 10 uses a single excitation to excite the 
respective dyes (i.e., the dyes are pan-excited). In this 
manner, all of the dyes are excited at once by using a single 
wavelength. Thus, there is no need for using more than one 
wavelength, nor is there a need to take multiple images and 
overlay the respective pixel images to generate a complete 
image. Alternatively, system 10 may use multiple 
excitations, such as two excitations, to excite the dyes, 
especially in situations where it is desirable to cover a 
relatively broad span of dyes. 

From the foregoing, it will be apparent to those skilled in 
the art that the present invention provides an efficient and 
reliable system for receiving and processing emissions spec- 
tra in connection with fluorescence microscopy. The system 
processes the emissions spectra to determine concentrations 
of plural fluorescent dyes in a particular spectrum, even 
where the wavelength bands of the dyes overlap. 

While the above description contains many specific fea- 
tures of the invention, these should not be construed as 
limitations on the scope of the invention, but rather as one 
exemplary embodiment thereof. Many other variations are 
possible. Accordingly, the scope of the invention should be 
determined not by the embodiments illustrated, but by the 
appended claims and their legal equivalents. 

What is claimed is: 

1. A method of monitoring cellular activity in a cellular 
specimen, comprising: 

applying a plurality of different excitable markers to the 
specimen; 

focusing light upon a region of the specimen from a laser 
microscope to excite the markers in the region and 
cause fluorescence to be radiated by the markers in the 
region; 

separating the fluorescence into wavelength bands using a 
spectral analyzer; 

detecting the fluorescence through an array of detectors, 
with each detector receiving one of the wavelength 
bands; and 

analyzing the detected fluorescence to identify the pres- 
ence of a contribution to the fluorescence from each of 
the plurality of different excitable markers. 

2. The method of claim 1, wherein the step of analyzing 
includes quantitatively determining an intensity contribution 
to the fluorescence from each of the plurality of different 
excitable markers. 

3. The method of claim 2, wherein the step of analyzing 
uses a linear unmixing operation. 

4. The method of claim 3, wherein the linear unmixing 
operation includes the steps of: 

storing the detected fluorescence in a memory; 

comparing the stored fluorescence with a model fluores- 
cence generated from a plurality of templates charac- 



US 6,750,036 B2 


7 

teristic of a fluorescence spectrum of each of the 
plurality of different excitable markers; 

varying the weights of each of the plurality of templates 
until the model fluorescence closely matches the stored 
fluorescence; and 5 

determining quantitative information about the intensity 
contribution to the fluorescence from each of the plu- 
rality of different excitable markers based on the 
weights. 

5. The method of claim 1, wherein the step of analyzing 10 
uses a principal component analysis of the fluorescence. 

6. The method of claim 1, wherein separating the fluo- 
rescence includes using a grating. 

7. The method of claim 1, wherein separating the fluo- 
rescence includes using a prism. 15 

8. The method of claim 1, wherein separating the fluo- 
rescence includes using a liquid crystal tunable filter. 

9. The method of claim 1, wherein separating the fluo- 
rescence includes using an acousto -optical tunable filter. 

10. The method of claim 1, wherein applying a plurality 20 
of excitable markers includes applying a plurality of fluo- 
rescent probes to the specimen. 

11. The method of claim 1, wherein detecting the fluo- 
rescence includes using a plurality of photomultiplier tubes. 

12. The method of claim 1, wherein detecting the fluo- 25 
rescence includes using a plurality of high gain photomul- 
tiplier tubes. 

13. The method of claim 1, wherein focusing light to the 
specimen comprises focusing light from a two-photon laser 
microscope. 

14. A system for monitoring cellular activity in a cellular 
specimen that contains a plurality of excitable markers, the 
system comprising: 

a laser microscope that is operative to excite the markers 35 
in a region of the specimen, wherein the markers in the 
region radiate fluorescence as a result; 

a tunable filter that is operative to process the fluorescence 
and to pass a portion of the fluorescence, wherein the 
portion of the fluorescence is within a wavelength band 40 
that depends on the setting of the filter; 

a detector that is operative to receive the processed 
fluorescence and to convert the fluorescence into a 
corresponding signal; and 
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an analyzer that is operative to receive the signal and 
identify the presence of a contribution to the signal 
from each of the plurality of different excitable mark- 
ers. 

15. The system of claim 14, wherein the analyzer is 
operative to quantitatively determine an intensity contribu- 
tion to the fluorescence from each of the plurality of different 
excitable markers. 

16. The system of claim 15, wherein the analyzer uses a 
linear unmixing operation. 

17. The system of claim 16, wherein the analyzer com- 
prises: 

a memory operative to store the detected fluorescence; 

a processor operative to generate a model fluorescence 
from a plurality of templates characteristic of a fluo- 
rescence spectrum of each of the plurality of different 
excitable markers, compare the model fluorescence 
with the stored fluorescence, vary the weights of each 
of the plurality of templates until the model fluores- 
cence closely matches the stored fluorescence, and 
determine quantitative information about the intensity 
contribution to the fluorescence from each of the plu- 
rality of different excitable markers based on the 
weights. 

18. The method of claim 14, wherein the analyzer uses a 
principal component analysis. 

19. The system of claim 14, wherein the tunable filter 
comprises a liquid crystal tunable filter. 

20. The system of claim 14, wherein the tunable filter 
comprises an acousto -optical tunable filter. 

21. The system of claim 14, wherein the detector com- 
prises a photomultiplier tube. 

22. The system of claim 14, wherein the detector com- 
prises a high-gain photomultiplier tube. 

23. The system of claim 14, wherein the laser microscope 
comprises a multi-photon laser microscope. 

24. The system of claim 14, therein the system further 
comprises a collector that at least substantially envelops the 
specimen to receive fluorescence from the markers. 

25. The system of claim 24, wherein the collector com- 
prises an integrating sphere. 





